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Foreword 



The early childhood education program is providing a major new direction to the 
education of California's schoolchildren. The program was launched when the state's 
Legislature and the Governor approved Senate Bill 1302 (Chapter 1 147, Statutes of 1972). 

Developed by the State Department of Education and^spohsored by the State Board of 
Education, the nevl^ program involved 172,073 chsfldrei;! in 1973-74, its first year of 
operation. A total of 1,01 3 schools in 800 school districts-80 percent of all school districts 
in the state-participated in the program. • ^ 

Prior to the establishment of the early childhood education (ECE) program, most 
educational change followed a fragmented approach along ^^categorical" lines. This approach 
resulted in the development of numerous special supplementary programs to solve specific 
problems in narrow areas of concern. By 1972 more than 30 different state and federal 
programs had been established to help solve problems for special portions of the general 
pupil population or to remedy special deficiencies in the school curriculum. The weaknesses 
,in such fragmented app'foaches were obvious: 

• Some programs emphasized remediation, trying, to make up for past failures instead of 
seeking to prevent problems. 

• None encouraged a comprehensive educational strategy for all children at the school 
' sites. 

• M^ny .were based on a search for a panacea which, if discovered, would immediately 
cute all of education's ills. 

• Many did not recognize the need for the commitment of all concerned -including 
parents, school boards, teachers, and administrators— to achieve success of a school's 
total program.. ^ - r 

The designers of ECE recognized these weaknesses and sought to correct them and at the 
same time to build on the positive aspects of the state and federal, programs that were 
already in operation. 

Early childhood education was built on the, premise that too often tlie public schools 
failed to capitalize on the unique learning opportunities in the early years of a child's life. 
Avoidable educational deficiencies developed in the education of our children as a result of 
the failure to provide adequate support in these early years. Costly remedial programs have 
consequently been required to overcome these deficiencies. 

Recognizing the need for additional support for school programs in the primary grades, 
the^arly childhood education program provided $130 per pupil enrolled. It is important to 
note the the ECE legislation reqiiired that at least 50 percent of the participating schools be 
those with the greatest educational need. For educationally disadvantaged children 
attending these schpbls, additional funds were allocated either through the ECE program or 
appropriate state and federal categorical aid programs. 

The concentration of additional funding on each pupil enrolled in ECE was combined 
with a plan of actioh. All districts seeking ECE funds were required to prepare an individual 
school-by-school pl^n developed by parents,, teachers, and administrators at the school site, 
which included provision for the following: . 

• * Assessing the educational needs of the local community 

• Restructuring the educational program in kindergarten through third grade, including 
' individualized instruction 
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• Defining nfeasurable program objectives ' *- \. ^ 

• Coordinating the use of all educational rfesources-federai^state, and local— to meet the 
needs of the cliildren * ' . 

• Involving parents directly in the education of their children 

• Providing staff development dnd inservice training \ # * 

' • Evaluating the results of the program ' . ' * 

• Requiring approximately a 1-to-lO adult-pupil ratio 

Tliis evaluation report shows that after the first j^ear of operation; 4he ECE program 
resulted in significant improvement in pupil achievem^fnt. 

In reading/language development, pupils participating in ECE made 11 months of 
educational gain for each 10 months of instruction^w^e typical learning rate for all cliildren 
is 10 months of growth for 10 months of schooling. Tlie typical^gain for disadvantaged 
cliildren not served by a special program is 7 months growth for 10 months of schooling. 
And, the typical gain for disadvantaged children enrolled in a successful compensatory 
education program of Title I of the Elementary and Secondary Education Act is month for 
month. When ESEA, TiU^, was made part of the comprehensive local planning process 
required by ECE, ho^p^r, Nie typical gain for disadvantaged children was increased to 13 
months for 10 mont|i§ of instruction. 

The ECE test scores probably underrate the actual achievement grovy^h of the total 
enrollment, sinco^ome schoolsWith the lowe.st percentage of disadvantaged pupils were not 
required to use/standVdized achievement tests. As a result, their gains are not included m 
the typical EGt pupil gain. \ ' 

In mathematics, pupils participating in the ECE program gained at the rate of 12 months 
for 10 months of schooling. As in the case of reading, the typical gain for all piipils in 
mathematics is 10 months gain for 10 months of schooling. The typical .gain for 
disadvantaged children not involw^d in special programs is 7 months for 10 months of 
schooli/g, while the typical gain fon disadvantaged children enrolled in special compensatory 
education programs is 9 months for\lO months of schooling. 

Since many schools with the least ;iumber of disadvantaged children were not required to 
participate in the ECE achievement Itests for mathematics, the actual ECE gain is probably 
liigher than the official figure indicates. 

In. addition to the reported achievement gains, the 1973-74 evaluation indicates that 
participating schools had initiated \a wide variety of programs to ifkiprove parental 
involvement in the education of thdir children. These programs ranged from providing 
general information to, parents about the content of school programs to helping pargnTs in 
specific education activities with theu" cliildren. Tlie program also generated substantial 
parent and community involvement inlschool programs. Approximately 23,000 volunteers 
and 8,000 paid aides were reported as llaving worked injECE's 1,0 13 schools in 1973-74. In 
addition, the evaluation found that ECE programs focused on improvements in techniques 
of individualized instruction and the lkc of diagnostic/prescriptive techniques. Programs 
providing diagnostic health services werd found to be particularly helpful for participating 
children. \ 

According to the 1 973-74 evaluation on the early childhood education program, nearly 50 
percent of the ECE schools included" locally determined components such as bilingual- 
bicultural education, English as a second\ language, musip, and art. The selection of these 
components resulted from assessments ofllocal needs, as rfe'quired of all participating ECE 
schools^ * . \ I . 

In the ECE effort the State Department of Education fias a threefold responsibility: 

1. To assure that appropriate planning, implementation, and evaluation have taken place 

2. To administer the expansion of the procranf 

3. To evaluate and report the statewide results of ECE 



In accord with these responsibilities, the Department monitored ECE in a variety of ways. 
All schools, for example, were required to subrhit detailed plans,.which were rated by ECE 
consultants. In addition, as part of a program^ audit, participating schools' ^lans were < 
reviewed by staff at the scliool sit^srl^arents, teachers, and administrators participated in 
this review. Apparently, this close attention to the implementation of each ECE school's 
plan is one of the most^important reasons why the program has achieved most of its goals. 

ECE policies also required fiscal controls which resulted in 59 percent of the schools 
'reporting expenditures within 5 percent of their estimated budgets.^ . ^ 

As with any major program in its, first year of operation, certain administrative 
refinements and progfam li^jprovements are required to keep ECE moving successfully 
forward. This evaluation report has pinpointed the following areas where action is required, 
and every effort will be made by the State Department of Education to respond to these 
needs: ' / - 

• Guidance is required for districts* regarding the distinction between parent involvement 
and thOeducation of parents, ^ i 

• Further requirements are necessary for the reporting of staff development activities, 

• Districts should* be encouraged to expand health and auxiliary services. 

• Standardized testing for all ECE participants is necessary. 

^ • Districts need to budget for locial evaluation at both the districjf and school levels. 

• Activities must be initiated to improve coordination with other state and local agencies 
to imprpve the delivery of local health services, 

In^ summary I believe that this report shows that the early childhood education program 
has resulted in significant gains in pupil achievement. The level of performance ac^hieved by 
ECE is unprecedented for a program of such magnitude. I further believe that these findings 
justify substantial expansion of ECE in the 1975-76 school year. ^ 

J congra'tulate the thousands of persons— teachers, school administrators, board members, 
community leaders, teacher, aides, stydents, patents, and Department of Education 
employees-who worked so hard to make the first year of this program a success for the 
.children. ' ^ > 

I commend the following evaluation report on their behalf to all Californians. 
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Superintendent of Public Instruction 
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Abstract of the 
Evaluation Report 
for Early Childhood 
Education 

Findings of the Evaluation 

Product Evaluatien 

Reading] hinguage dexelopment The early child- 
hood education (ECE) schools reported that they 
made serious efforts in 1973-74 to restruc^re 
language and reading programs by using diagnostic 
and prescriptive materials. The extent to which the 
efforts in restructuring programs were successful is ^ 
indicated by the higli level of achievement gains 
reported. Tlie typJical student in the ECE program 
attained 1.1 months gain for each month of instfuc- 
tion, with sorpe school gains as higli as 1 A months 
per month of instruction. Because sOme ECE schools 
were not required to use standardized achievement 
.tests, the test scores reported may, in fact, be an 
underestimate of the actual pupil growth. 

Mathemdfics. For mathematics programs the • 
schools reported a variety of activities designed to 
improve pupil performance. The success of these 
programs can be judged by, a reported typical gain, 
of 1 .2 months for every month of instruction. 
Again, since all schools did not use standardized 
tests, the reporter! gain may, as in the case of the 
reading/language development component, be an 
^ underestimate of the actual gain. 

^Healthfauxiliary services. Schools *with success- ^ ^ 
ful ECE programs rated diagnostic services in 
particular as the most helpful and most importaritr 
There were several* discrepancies between the 



schools' judgments of 'which health/auxiliary -ser- 
vices were most, important, on the one liand, and 
wliich were the most effectWe, on the other. The 
schools judged attendance and dental and medical 
services to be the most important but did not find 
them to be effective in accomplHshing school goals. , 

Parent education. Most schools, with the goal of 
reinforcing their education programs, simply^ 
attempted to provide general information to the 
parents about the content of their progpatns. A few 
schools, recognizing that the parents' needs differed 
from the original assessment c^. iteeds that ha^ 
been made, changed their parent education pro- 
grams some time during the year. A few other 
schools which experienced the same problem but 
which- had not dhanged their approach to parent 
education reported that they planned to make 
program changes' in the future. 

Optional component Tlie optional component 
covered a wide range of program choices. Schools 
could choose to. implement any activity th^t met 
their unique needs and interests. Nearly one-half of 
the ECE schools included an optional compohent 
such as music, art, bilingual-jbiculjural education, 
and English as a second language. At least ^0 
percent of the optional programs were also re- 
ported as having been fully or partially realized. 

Parent participation and community involve-- 
ment. Significant numbers of volunteers were 
involved in the £CE schools. in 1973-74. Approxi- 
mately 23,000 volunteers worked in Oie ECE 
programs of the 1,013 participating schools, and 
another^ 8,000 paid aides were also Involved in the 
ECE program. . 

Parent involvement activities were most often^ 
reported in terms of pupil performance and in- 
creased parent attendance at school* conferences 
and meetings. At least 34 percent of the schcfols 
still felt that the.y needed to involve more parents. 

Staff development. The staff develppment activi- 
ties in the early childhood education schools 
generally focused on improvement in techniques of 
individualized instruction and on the use oi 
diagnostic/prescriptive materials. ''College classes 
were ranked high in importance but low, in effec- 
tiveness, and demonstrations wefe ranked, Ipw in 
ipiportance but high in effectiveness. 

Process Evaluation 

The ECE program implementation design was 
carefully developed. Schools submitled^ detailejd 
plans, which Were rated by ECE consultants;. 



schools were vfeited by JECE consultants far the 
* purpose of making program audits; and schools 
were required to report on their time management 
system by completing three periodiq reports. Scru- 
tiny of the schools' implementation of their plans 
resulted in a closer match between' plans and ^ 
Outcomes compared to prior efforts with other 
special funding programs. Th% schools' own process 
reports were evaluated in terms of expected levels 
of achievement so that direct services could be 
given to schools. 

Fiscal Evaluation 

Fifty-nine percent of the , schools reporting 
showed expenditures within 5 percent of their 
estimated budgets. 

Salaiits of aides and certificated^ staff and 
related fringe benefits accounted for 68 percent of 
school level expenditures. Instructional supplies 
and book? accounted for an additional 17..8 per- 
cent of the budget. 

Conclusions of the Evaluation 

This report represents a statewide summary and . 
analysis for the first year of programs funded 
^mder early childhood education regulations. In f 
, 1973-74 all state and federally funded programs 
were approved ofi the basis of a consolidated appli- 
cation form that was designed to combine the fund- 
ing sources available to a school or school dfstrict. 
This report on the ECE. program is the'^firsl of a • 
series of evaluation reports prepared from the con- 
solidated application and the evaluation processes. 

-The conqlusions of this evaluation report on the 
early childhood education program for 1973-74 
follow: , 

• The performance levels which were reported, 
indicate that* pupils enrolled in ECE programs 
geneially achieved substantial gains in the 
reading/language development corhponerit, and 
in the mathematics com'ponent. These gains 
exceeded expected performance levels in all cases. 

• Most participating schools wfe able to meet the 
objectives that they set in their individual school 
level plans. * • % ■ 

• Significant numbers of $upport and volunteer 
personnel were directly involved in the imple- 
mentation of the ECE program. 

• Thfe results indicate a cloje relationship betv/een 
' ^OH^rri planning aind rmpfefnehtation; however, 
. furtner refinement is necessary. 

• The distinction between the parent education 
4nd parent involvement components was not aS 



well defined in practice as it was in the program 
policies and guidelines. 'In tob many cas^s, 
"education" meant participation in school 
activities, and "involvement" meant better 
understanding of child growth and development. 
' Staff development objectives reported most , 
often related to the improvement of teacliing 
techniques in reading, mathematics, language, 
and the general curriculum. Staff development 
was rarely evaluated in terms of the implementa- 
tion of the inserace training in the classroom. 
Very little rnohi||| appears in school budgets for 
health/auxiliary services. Schools were encour- 
aged to obtain services from community re- 
sources, but the reports from many schools 
indicated that the most important services, 
dental and medical, were the least effective in 
terms of actual implementatioiif of school plans 
The research report on the inclusion of fopr- 
year-olds in the program was not part of this 
year's evaluation report.' .Tliis study will be 
•delayed until more data have been collected on 
the success of the ECE program in meeting the 
goals presently set for the kindergarten through*^ 
grade tliree population. 



Areas Needing Attention 

a result of the evaluation of the early 
cliildhood education program, the following mat- 
ters have been identified as needing attention: 

•\Schools conducting ECE programs need to plan 
^ to cpllect achievement, data on normative stan- 
dardized tests, at least 'annually, to provide a 
comparable data base for all ECE schools in the 
state of Oalifornia. ^ 

• Scliools in which reading achievement levels 
exceeded the state's expected level of achieve- 
ment but that failed to meet their own objec- 
tiyes need to have their programs thoroughly 
reviewed; schools that met their objective? need 
to have their programs reviewed to determine 
wh^t factors made their programs successful. 

• In order to determine if programs met with 
success or failure, the State Department of 
Education needs to retain the present applica- 
tion and evaluation processes (with minor modi- 
fications) for a three-year period of time. 

• The "program-implementation" reporting pro- 
cess needs to be revised by 'the State Department 
of Education to clanfy the concept of time- 
management evaluation. "Timp management" 

\ refers to the process of implementing thckctivi- 
ties planned within each component according 
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to the time schedule in the school plan State ' 
inserviQe' training programs need to be directed^ 
toward time-management concepts and proce-* 
dures by whiclr school plans sjiould be amended. 
At the district level, provisions need to be 
made so that schools not onl> plan but also 
budget for' pjogram evaluations. School district 
personnel^administrators or teachers) need' to 
be assigned *the responsibility for program eval- 
uatieli within a school district and at 'a specified 

j\oo\ site. ^ ' ^ * 
Data collected by the Department of Education 
from norm-referenced standardized achievement 
tests need ta be in the form of raw scores, 
permitting analysis and conversion of those 
scores and ag^egation of them for several 
schools. 

The State Department of Education, in coopera- 
tion with the States DtJpartment of Health and 
county health departments, needs to explore 



>^ays in whibh health service's can be provided 

jnore effectively to ECE schools^. 

Cooperatives are formed when small . school 
district programs are administered througli .a com- 
mon local educational agency fusually the office of 
a county superintendent of schools. Four-hundred 
three smag^chool districts were iunded through 
cooperatives. The following matters wliich related 
to the cooperative projects have been identified as 
needing attention: 

• Tlie role and responsibility"^ oP cooperative pro- 
jects need -to be more clearly specified in 
guidelines and regulations. For administrative 
purpose^, cooperative projects are treated ,^s 
local ageaciea, but the extent of .'cooperative 
projects' authority to implement their functions 
is #Dt spelled out. 4^ 

• A separate- application and reporting process, 
appropriate to the. special needs of small dis- 
tricts, needs'to be developed. ; ' • - ^ 
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Chapter 1 

Introduction 



The intent of th^ early childhood education 
prograifi (ECE) and^ubsequent legislation was to 
provide a 'comprehensive program for cliildiien in 
kindergarten and grades one, two, and three. Tliis 
program was to bp developed ^ each school 
district. Under the provisions of Senate Bill 1302 
(Chapter 1 1 67, Statutes of 1972), a comprehensive 
school-by-school master plan for the primary 
grad,es was to be developed at each school with the 
participation of parents, teacJiers, and administra- 
tors .that would assure : 

\i 

: • (k) A comprehensive restructuring of primary 
education in California, kindergarten througli 
third grade, to more fuUy meet the unique 
needs, talents, interests, and abilities of each 
child. - 

(b) That early educational programs that are 
or may be made available to<;hildren who are 
3 years and 9 months of age be coordinated 
with tile restructuring of primary education in 
Califortiia in order to take advantage of the 
capacity, for learning of children at this age 
level. 

(c) The cooperation an(} participation of par- 
entS in the educational program to the end 
that the* total community is involved in the ' 
development of the program. 

(d) The pupils ogj^pating/will develop an 
increased compet«?cy in the skills necessary 
to the successful achievement in later school 



subjects such as reading, language, and mathe- 
matics.^ 

• Efficient allocation of all funds available to 
each school for the implementation of coordi- 
nated early childhood education programs.^ 

• Individualizes instrtiction to see that every 
child's needs, talents, interests, and abilities 
will be accommodated. ' ^ ' ' 
A classroom^staffing" pattern in whiQh the adult- 
pupil ratio is approximately 1 to 10 by employ- 
ing teacher aides, velunte&rs, and parents.-^ 

The early childhood education program has been 
designed to be phased in t& all elementary schools, 
over a period of years. In this first year, 1 2 percent 
of ^e kindergarten and grades one, twp, and three* 
population was to participate IfMhe program. At 
least one-half of the student participants were to 
come from schools identified by the local district 
as being of the greatest educational need. The 
following evaluation report is based upon the data 
collected from the participating schools. 

In the 1 973-74 school year, approximately S24 
miHion'was allocated to 1,013 ECE schools. A 
total 0^130 was allocated for each student,, with 
additionaj funds made available for disadvantaged 
pupils. Tliere were 1 83 schools that received the 
S130-per-pupil ECE funds; ^tlTe other schools 
received the basic grant of $130 for all children, 
plus extra funds for students identified as educa- 
tionally disadvantaged youth (EDY). A State 
Board of Education policy provided a minimum of 
$350 to a maximum of S550 per child for. the 
specific needs of educationally disadvantaged 
youth.. Of the S350 to S550 allowable expenditure, 
for the educationally disadvantaged youth, '$65 
was funded for children in kindergarten and grades 
one, two, and three with ECE funds; the balance 
was funded by a combination of ESEA, Title I, and 
Senate Bill 90 EDY funds. 

During 1973-74, approximately 800 school dis- 
tricts throughout the state provided ECE programs 
for 172,073 pupils in kindergarten through grade 
three. This group represented 14 percent of the 
statewide enrollment. Since districts with only one 
school wece fundeclat 50 percent (usually all of their 
kindergarten and grade one students), »the actual per- 



Cahfornw Education Code, Division 6, Chapter 6.1, Section 
6445. 

Karly Childhood Education Recommendations for Program 
Implementation. Prepared under the' direction of H. Glenn Davis. 
Sacramento California State Depart/nent of Education, 1974. 

^Policies for Early Childhood Education. Prepared under the 
direction oi H. Glenn Davij. Sacramento. California State Depart- 
ment of Education, 1973, pp. 4 aad 5. 



cent funded larger than, the 12 percent planned 
for the first year, ^ 

Some of the early -chij^hDod education schopis 
were funded only by £CE monies, and others vvere 
njultifunded with other state and federal funds, 
this money was specifically allocated to supple- 
ment district effort, not supplant it. The report 
will, separate data for the various funding sources 
when such separation is required for clarity of 
information. If separation is not required, the data 
will reflect the total early ' childhood education 
program for 1 973-74. 

The required components of the ECE program 
are : * ~ ^ - - . 

• Reading/language development 

• Mathematics 

• Health/auxiliary services - ^ 

• Parent participation and community involve- 
ment 

• Parent education 

• Staff development and inservice education 
Each school (parents, teachers, administrators) 

was to develop a plan, including all of the 
components listed above. This plan constituted the 
terms of a contract between, the sphool di^rict and 
the state. The ECE 'plan included measurable 
objectives in all component;^ fSchool staftgenerally _ 
evaluated the plan by "hard'* data such as achieve- 
ment tests in academic areas and "soft" data, such 
as questionnaires or observations in the support 
areas. All of these components and their evalua- 
tions are reported in this evaluation document, 
along with the process evaluation information and^ 
the fiscal report, as required by the enabling ^ 
legislation, * ^\ 

The ECE program has been operational in 
California public elementary schools for one full 
program year. Tljis 'V^" actually includes several 
months of preprogram planning time and addi- 
tional months for revision, evaluation*, and resub- 
mission of school plans. 

• By law, the program evaluation of ECE vvas con- 
cerned with both the process of program implemen- 
i tation and the product of tlie program. The-f^low-- 
ing areas were covered in the evaluation process: 

• The extent to which major program functiops- 
were accomplished, ias well as quantitative, 
estimatejs of pupil progress which werejfe-^ 
ported for each participating school. (See 
Education Code Section 6445.10.) 

• The changes or b^nefits-J'eslilting from^.tbe 
accomplishment of rp^r functions. The statr 
utes require an amflial review of the success of 



/ each local district.in meeting the objectives of 
^ts Approved plan^As a result^f the annual 
evaluatipt\, programs considered to be success- 
ful in me^i^g their obxectives will be contin- 
ued and their program expanded. (See Educa- 
tion Code Sectiort^445:80 ~ ^ . 

The success of the local district in qieefing its 
objectives was determined- primarily- from the data 
in the required annual report. y»S^as, therefoxQr the 
responsibility of the locaf prograbi staff io provide 
an adequate local evaluation^ to document the 
success of the program in meeting the district's 
objective^. The annual distri^ report form re- 
quested information related to: O) fiscal expendi- 
tures; (2) degree and success of program injplemen- 
tation; and (3) quantitative estimate of pupil 
progress. 

The district collected and reported the required- 
data, school by school. From these data, the State 
Department of Education . derived a composite 
score for each school. This composite score was 
derived and weighted as shown in Table 1. 

The State Department of Education computed 
an index of student attainment for each participa- 
ting school, using factors which have been shown 
to be predictive of school success. 

Participants in the Early Childhood 
Education Ptogram 

In the ECE program, all children within a 
funded class were defined as program participants. 
The only children^t a funded grade level within a 
schoi^ who y/ere not participants were those 
assigned to varibcis special^ education day classes 
such as classes for ^he educationally handicapped. 
Children who were assigned to special programs for 
a limited part of the dky, but who were counted on^ 

Table 1 _ ' 

Method of Weighting Evaluation Areas' 
for EC E School Composite Score 



Area evaluated 
for degree 
of success 



' Fiscal 

management 
Program^ ^ ^ 

implementation 
Pupil progr^V^ 

^ " '• s-V 



Weight for composite scorgT^p 
by percent ^ ' ' 



First 
year 



>20 

70 
10 



Second 
year 



10 

\40 



Third and 
following years 



50 
50 



KLC 



0 0 01 5 



r 



the regular class attendance rolls for purposes ofr 
computiog average daily attendance^ were con- 
sidered ECE pf<>gram participants? Table 2 shows 
the total number oT student partidpants grade 
level/ * _ . ' " ' 

Program participants ia Ibe early childhood 
education program included parents, school per- 
sonnel, and other community r^embers. In each 
'program^ component there were different combina- 
ti'oijs of participants. TaUle 3i depicts the number - 
of participants who were involved in at least 75 

Table 2 

Students in ECE Program Compared to Total 
Statewide Enrollment, 1973-74 





Total 


.ECE Students 


Grade 






Percent 


level 


enrollment* 


Number • 


of total 


Kinder- 








garten 


3.07,22^3 


52798 


17 


One 


313:541 


52,279 


17 


Two 


308J31 


35,165 


11 


Three 


321.4B8 


31 ,831 


10 


Total 


1.250;363 


172,073 - 


14 



♦Total slate enrollment as o/ December. 1 974 



percent of the activities in eaciv component. 
Participants who were involved in moj^e than one 
coniponent were coiuited for each component in 
which they participated (duplicated count). Two 
of the components, mtergroup relations and Eng- 
lish as a second language, were not mandatory for 
all ear4y childhood education schools. In)tergroup 
relations w^s required only for ECE schools co- 
funded with ,ESEA, Title I; and English as a second 
language or bilinguaf education was r^cjuired in 
schools where there was an identified need for such 
programs, The optional component was included, 
• by choice, in many ,early childhood education 
school plans ^and included activities not described 
or contained in other components. ' • 

- Personnel in tfie Programs 

The number of persons (full-time equivalent) 
employed in early childhood education programs is 
shown in Table 4. When schools reported using 
rhultifunds tor their programs, the exact number 

, of positions funded by ECE monies was not 
identifiable. Instructional aides and teacher assis- 
tants constituted the largest category of persons 
hired! A total of more than 23,000- volunteers 

. contributed a significant portion of time to the 
program, * 1 



Table 3 

^Total 1973-74 ECE Program Pprticipants, by^Component 



Vrogram comjDonent 



Reading/language development 
Mathematics 
Auxiliary services 
Intergroup relations 
Parent participation and 

community involvement 
Parent edujcatiori , 
Staff development 
English as a second language 

or bilingual education 
Optional component ^- ' 



Number of program participants* 



Students 



281,873 
273,002 
256^61 
^10.054 



'53,326 



Parents 



117,856 
65,461 



4,037 



School 
personnel 



27,105 



2,061 



Othert 



2.146 
-1,646 
2 J 83 
1.905 

1,898 • 
690 



248 
824 



*ln vchooh having niultifunds. grades f(?ur through eigh't arc mciudwi. Children who participated 
one component are counted for each com(>onent. ' >^ ' . 

t**0ther** includes persons from the^ommunity aod nont^rgp1t{»iIdr(jri m upper grades. 

/ ■ •' ' ' ^ 



in (nore than 

i 
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Information presented in the tables included in 
this evaluation report, as well as tlie information 
reported by the consultants from the Earfy Child- 
hood Education Management Team who visited 
each school, indicated* that parents and other com- 
munity persons volunteered theii^ services to the 



schools. More than 23,000 volunteers were reported, 
excluding the cross-age tutors and older elementary 
children who helped in classrooms. The consultants 
found that a real effort was being made to lower the 
adult-pupil ratio, and the reports from schools con- 
firm that this was an area of major concern. 



Table 4 - 



Personnel Wprking in the 1973-74r&CE Program (Full time equivalent) 





ECE 






Type of personnel 


funded only 


Multifunded 


Total* . 


Classroom teachers ^ » . _ 




1 I'^K 
1 , 1 OO 




Rp;iHinD soeciaiists 


32 


" *874 


906 


Matfiematics specialists * ' / ^ - " 


_ 4 


.281 


286 


English as a second language , 








nprcnnnel (Title 1) 




• 153 


154 


Bilingual specialists (AB 2284) 


\ 12- - 


^ - -84 




Teacher aides and assistants • ^ ' ' . 


t957 - 




7,913 


. Community aides 




-454 


.553 


' Dir8Ctors,supervisors^oordinators, ^ - 








and resource personnel 


. 4.2 - 


444 


486 


Counselors'. 


4 ^ 


ti5 


119 


Library media specialists 


5 




67-' 


Library media aides ^ ' 


15 


160 


176 


Teacher librarians ^.^ . . .-^ ^ 


1 


' ;'21 


22 


Psychologists and |3sychometrists^ r 


4 


55 


59 


Social workprs and attendance counsdors 




18 


* 18 ' 


Nurses,^ / ' -? ; 


2 


124 


126 


Clerks and custodians ^ 


84 


211 


361 


Evaluators » ' , ' 


1 


43 


44 


Other paid en\pioyees • ' 


33 


304 


337 


Total paid personnel 


*1,580 


11,562 • 


13.142 


Unpaid volunteers! 


5^01 

* 


17791 


23,292 



*In some casesMata include personnel hired for grades four through eight. 
tTypes not listed. . 
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, ' : Chapter 2 

Program 
implementation 

* 

/ The data collected show that a program with well- 
defined plans and program audits can be evaluated 
with greater confidence in the accuracy of the 
^evaluation product , thdn a pro^m with poorly 
defined plans. " ^ ' 

The legislative mandate for the yearly evaluation 
'of tfie early childho^ education program requires 
an' emphasis on the de^ee to which the program is 
bnplemented./During the fijst year, program imple- 
mentation constituted' 70 percent of the overall" 
ev^uation ranting for each school; during the 
second and succeeding years, 50 percent of the 
overall evaluation ratihg will be based upon pro- 
gram injflementation. The remaining 30 perceiit in 
the first year anci^O. percent in the^second year are 
related to studenf ^)rogress and fiscal nfianagement, 
as prescribed in the statutes. 

The program implementation data for 1973-74 
were obtained from three sources. First, each 
participating school submitted a school-level i5lan. 
Form A-127-S. Using a form developed by the 
Early Childhood Eciucatign Management Team, 
/each plan was reviewjed and^independently rated by 
at least two team members. The average of the 'two 
ratings was converted to a standard score. When 
the results of the two independent ratings differed 
m>ve than a id amount, a third independent rating 
was condycted, and|fie three ratings were averaged 
'an4 converted to a standard score for that school. 



From December, 1973, through the first week 
of March, 1974, a totahof 870 of the 1,013 early 
childhood education schools were visited by the 
Department of Education's early childhood educa- 
tion program audit teams, and the reports of these 
teams comprised the second source of program 
implementation data. Due to Jimited time, 140 
very small schools funded for less than $4,000 per 
school, were not visited, 'the on-site program audit 
Consiste(i of a visit to , the school by one or more^ 
consultants from the ECE Management Team. The 
fornix and program audit review directions were 
sent to each school at least' two weeks^before the 
scheduled visit so that self-evdluation by the 
parents, teachers, and principal could be done. The 
purpose of the^rogram audit was to review the 
program in the first^j^ar of c^^ration to: 

1 . Determine whether or not all. statutory* re.- 
quirements were being^jnet, witlt special 

^ emphasis on parental fcvolvement in planning, 
^ implementing, and evaluating the program at 
the school-site level: 

2. Assess the quality of the program as it was 
being implemented in comparison with (a) the 
individual school program design developed 
by each school; and (b) the intent of the 

' program as set forth in the Early Childhood 
Education Task Force Report and the State 
Department of Education's early childhood 
education recommendations, as authorized ]by 
stafute. - . 

» • • * 

While in the school, consultants observed class- 
room activities; interviewed p^ents, teachers, and 
staff; and, using a 10-point scale^Ixated th© school 
on an observed implementation of the sehool's 
own early childhood edux:ation plan. These ratings 
were converted to a standard score. 

A third evaluation procedure was developed by 
the\ Office of Program Evaluation and Research as 
part of the consolidated evaluation format, Jpiis 
procedure was incorporated, in the E-l 27-1 form, 
which was a report due frotn each school in 
December, 1973; April, 1974; and with the final 
evaluation, report due in July, 1974. The first 
report (December, 1973) was also converted to a 
standard ficore. The quality rating of the school 
plan, as designed by each school;' the quality of 
implementation, as determined by the program, 
audit; and th^ results', of the December, 1973, 
E-127-I evaluation Teport were used to rank 
schools fo^r ehgibility fot expansion candidacy. , - 



• Determination of eligibility for expansion funds 
for 1974-75 was based on the ranking of schools, 
using each of (i|fie three sources of information 
weighted as follow^: 50 percent for the program 
audit; 25 percent for the school-level plan, and 25 
percent for the December program implementation 
report. Table 5 shows the data used for expansion 
eligibility. 

School districts whose programs were deemed 
low in quality by these three measures were denied 
eli^bility for expansion candidacy. They received 
direct service from the ECE staff to help them 
* improve ^their programs. These schools' programs 
will be reevaluated in 1974-75 to determine their 
eligibility to expand programs in the 1975-76 
school year. 

The final determination of the degree and 
success of program implementation was made by 
reweighting the previous^lements, as follows: 40 
percent for program audit, 20 percent for the 
school-level i^lan, and 20 percent for the December 
and April implementation reports. This factor 
constituted 70 percent of the overall evaluation of 
the school. 



In the program implementation report sub- 
mitted to the Department of Education, reasons 
for not implementing plans a^ scheduled were 
identified in six categories: personnel, materials, 
parent and community participation, fiscal, time 
management, and planning. 

Tlie analysis of the first program implementa- 
tion report showed that certain reasons were cited 
more frequently than others.^Tlie category, **insuf- 
ficient time allocated in original planning for 
completion bf activity," was the most frequently 
mentioned reason for nonimplementation of activi- 
ties. The component that appeared to be the most 
cfifficult to implement on schedule in early child- 
hood education multifunded schools was inter- 
group rela,tions in which 10.7 percent of the 
activities were hot implemented on schedule. Ten 
percent of the activities scheduled for parent 
education were not*impleraented on schedule. 

Table 6 shows the distribution of activities by 
component for the first program implementation 
report. ^'Activities" were defined as events that, 
taken collectively, were considered necessary and 
sufficient for achieving the objectives within each 
of the components of the program. 



Table 5 

Statewide Distribution of Score? for Determination 
of Expansion Eligibility, Spring, 1974 









Mean 
standard 




School mean scores 




Weight 




Standard 


by quartile 












Scoring criteria 


by t)ercent 


Funding 


score 


deviation 


Q1 * 


Q2 


Q3 


ECE school's 




Partial ' 


48.3 


8.9 


41.1 


47^ 


54.6 


own plan rating 


25^ 




'54,2 


9.1 


47.1 


54/.8 


6J.2 


Degree of program 
implenc^entatlon 












^2.5 






Partial 


50.8 


97 


46.8 


57.5 


by December 


25 


Full 


49.9 


7.5 


45.3 


50.8 


55.2 


Department 
















program 




Partial 


•47.2 


9.7 


41 J 


47.1 


53.8 


audit 


50 


Full 


52.5 


8.1 . 


47.V 


5Z3 


58.1 



Total distribution 





Real scores by quartile 






Funding 


Q1 


02 


. 03 


Average standard score 


Standard deviation 


P^artial 
Fulh 


^177.5 
197.9 


193.1 \ 
. 208.3 


210.8 
222.7 


193.6 
209.0 


. 26.7 
21.9 



The ratings of the on-site program audits and the 
school-level plans were compared. Generally, the 
average effectiveness rating corresponded to the 
quartile distribution of the on-site program audit 
and the school-level plans. Table 7 shows the 
average effectiveness rating for early childhood 
education scl^ools by quartile distribution. Effec- 
tiveness ratings derived from the school evaluation 
reports, as d part of the consolidated evaluation, 
were based on a 1 to 5 scale, with 1 representing 
**exemplary!' and 5, "failure." 

The dat;a in Table 7 indicate that the schools 
which rat^d higher on the on-site program audits 
and on their school-leyel plans tended to be more 
successful in implementing their f)lans. It appears 
that the prescribed program planning process by 
the state, coupled with a detailed program audit 



conducted by State Department of Education 
personnel, produced information about program 
results which can be evaluated with greater confi- 
dence than has been true historically when infor- 
mation was obtained by end-of-the-ye^ district 
reports only. 

Individual schools of overall higli quality or with 
high quality components such as reading, parent 
participation, or bilingual education can be identi- 
fied. 

As a' result of this improved program assessment 
process, the Department of Educatibn now has 
baseline data on each school which produces 
program evaluation capabilities such as longitudinal 
analysis and program component analysis, based on 
both weaknesses and strengths, which was not 
possible in the past. 



Table 6 

Distribution of EC^ CIassroom. Activities Reported 





Number of activities 


Activities not implemented^ 










Percent of total 


Program component 


Proposed 


Implemented* 


Number 


proposed 


Language development 


10,569 


8,292 


761 


7-2 ^ 


Mathematics, 


7,362 


5,800 


611 


8,3 


Health/auxiliary 










services 


6,839 


5,440 


^ 625 


9,1 


Intergroup relations ^ 


/ 2,688 


1,906 


287 


10,7 


Parent participation ' 


6,250 


4,860 


'523 


8.4 


Parent education 


4,082 


3,037 


408 


10,0 


Staff development 


6,219 


5,009 


435* 


6.1 


Optional 


4,542 . 

A' 


3,784 


276 . 


11,8 



*!'or entire year. 

tl rom September through March 



I 



n 7^ 

, Distribution 

,of evaUliation 
y quartile 



Table? ^ 

Average Program Effectiveness Ratinigs Compared to Results of On-site 
^CE Prodram Audits and SchooMevfel Plan Ratings 



r^tmgs^^ 



Average effectiveness ratings, by component* 



Language 
development 



Mathematics 



Health/ 
auxiliary 



Parent 
participatjbn 



Parent 
education 



Staff 
development 



program audit 
BelbyvQI 
QiLq2 
Q2-Q3 
,Above Q3 

School-level plans 
Below p1 
Ql -02 

02*- 63 ; 
Abo>^eQ3 



2.6 
2.5 
2.4 
2.4 

2.7 
2.5 
2.4 
2.3 



2.8 
2.6 
2.7 
2.6 

2.9 
2.8 
2.6 
2.6 



3.0 
3.0 
3.0 
2.9 

3.1 
3.1 
3.0 
2.9 



2.8 
2.4 
2.5 
2.4 

2.5 
2.6 
2.5 
2.5 



2.3 
2.3 
2.2 
2.1 

2.3 
2.3 
2.3 
2.0 



2.9 
2.8 
2.7 
2.6 

2.9 
2.8 
2.7 
2.7 



*The avjerage effetttveness rat»ngs, based on a 1-5 scale, were deris/ed from data indeper>dent of the program audit and school level plan 
evaluation. The mean. score 1$ between 2 0 and 2.49 . , * 
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Chapter 3 

Product Evaluation 

Pursuant to the statutorily required annual 
evaluation, data were collected to determine the 
degree of effectiveness of each of the six manda- 
tory components in the early childhood education 
program. The six components are: 
\ \. Reading/language development This compo-' 
% nent includes ' reading, readiness, decoding, 
comprehension, and use of written language. 
The component •covers writing skills, includ- 
' ing grammar, punctuation, and spelling, in 
addition to the reading skills that can be 
evaluated through reading achievement tests. 

Language develop«ient also includes devel-^ 
opment of facility in or^l language , for all 
students Who use standard English, liinited 
'English, and dialects. Language development* 
may also include English as a second language 
(ESL) and/or bilingual programs. 

2. Mathematics,.TlriQ mathematics component 
includes numbers readiness, computation skills, 
and concept devefopment and application. 

3. Health/auxiliary services. Counseling and guid- 
ance, attendance, 'nutrition, library, and 
health services are included \x\ the health/ 
auxiliary services component. Health services 
include screening ^nd diagnosis, referral, and 
follow-up efforts in t^ie areas of visual, audi- 
tory, dental, physical, and emotional health. 
For ECE (Senate Bill 1302) funding, health is 
the only required service in this component. 



/ 

t 

4. Parent education. This component includes 
activities designed -to enable parents to be- 
come an integral part of tl\e education of 
their children. 

5. Parent participation and community -involve^ 
ment. This component includes participation 
in program plapning,'implementation, modifi- 
cation, and evaluation. Also included is direct 

. involvement -of parents in the formal class- 
room education of their children. 

6. Staff development \nd inservicc education. 
The employment, recruitment, and assign-, 
ment of teachers and* paid and unpaid aides 
are included in the s^gtfsaiia ndatq iy compo- 
nent. Included are preservice and inservice 

, training activities for tdachers, other profes- 
sional staff, aides, and volunteers. 

Reading/Language Development Component 

In the reading/ langi4age development component, the 
achievement test scores showed an average gain of I I 
months of growth per month of instruction in grades 
* one through three. In some program combinations, 
these gains were as high as 1.4 months. ' 
Tlie reacting/language development component 
was directed toward improvement of reading skills 
and of written and oral language skills. Partici- 
patmg schools were encouraged to restructure their 
reading and language pro-ams by using a variety 
of methods and new instructional materials. 

Participation in Reading Instruction 
' A total of 134,470 students in kindergarten and 
grades one, two, and thr^e were tested in reading/ 
language development activities in the ECE pro- 
gram. Table 8 shows the number and percent^of 
students tested by grade level. Students in ECE 
language development programs also were reported 
by the severalrfCunding sources; the number and 
percent of students, by funding swrce, are pre- 
sented in Table 9. Schools used a variety of tests to 
assess this component. When norm-referenced test 
results, were reported, the data were aggregated. 



Table 8 

Number and Percent of Students Tested in ECE 
Reading/Language Development, 1973-74 



Grade level 


Students tested 


Number 


Percent of total 


Kindergarten, 


28,944 


- 21.5 


One 


- 39,145 


' ^9.1 


Two 


34,392' 


25.5 


Three 


32,079 


23.9 


Total 


• 134,470 


100.0 
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specific evaluation process focused on the effec- 
tiveness of individual programs in meeting thefr 
own plan objective, poorly stated objectives alone 
may have caused low evaluation ratings for some 
programs. Programs with less measurable objectives 
frequently yielded findings that were not directly 
related to their stated objectives. (See Table 10.) 
Objectives were either exceeded or at least partially 
attained by nearly 600 participating schools, 
according to their own reports. 

Analyses were also made fo determine the types - 
of activities most frequently reported by programs 
whose objectives were either exceeded, attained, or 
partially attained. The activities most frequently 
reported by successful language development pro- 
grams are presented in Table 1 1 and show that 
diagnostic and prescriptive materials were used 
most, frequently. The kinds of activities reported 
by schools for enhancing student performance 
suggest that ECE schools actively sought to restruc- 
ture their language and reading programs. 

A variety of methods to evaluate the effective- 
ness of language development programs was 
employed by ECE schools. The most frequently 
reported evaluation activities successful in measur- 
ing reading progress are reported in Table 12. The 
use of two or more standardized tests either used 
alone or with locally develop^ criterion- 
referenced tests was reported by more than 50 
percent of the schools^ ' ' ' 

Although the use of norm-referenced tests in 
schools funded with only ECE monies was 
optional, ECE schools funded with either ESEA, 
Title I, or educationally disadvantaged youth (SB 
90) monies were required to administer stand- 
Table 10 



.Quality of ECE Schools' Objectives infleading/Language Development Programs 
• for Each of Six Types of 'Results Reported, 1973-74 





Average quality of schools' objectives, by percent 








Vague but 




Number 


Type of results reported 


Measurable* 


measurable* 


Nonmeasurable* 


of schools 


Exceeded objective ' 


88.8 


11.2 


0.0 


240 


Attained objective 


64.3 


32.8 


2.9 


235 * 


Partially attained objective 


75.0 


19.8 


5.2 


116 


Did not attain objective 


76.6 


6.7 


16.7 


30 ' " 


Results not stated 


42.4 


19.2 


38.4 


146 


Results not related to objective ^ 


25.1 


12.1 


62.8 


199 


Total schools 


'60.7 


18.7 ^ 


. 20.6 


966 ' ^ 


Average percent 


' 79.4 





*A$ defined by ftcparlment evaluation consultants 
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Objectives, Activities, and Findings 

Morcthan 79 percent of all ECE school evalua- 
tions contained statements of measurable objectives. 
Objectives were most frequently stated in terms of 
growth per month of instruction, as measured by 
norm-referenced standardized tests or by the up- 
ward shift of student scores in three different quar- 
tile ranges. The quartile ranges are presented in 
terms of national norms. 

Comparisons* were made between the measurable . 
qualify of the objectives (as determined by Depart- 
,ment of Education evaluation consultants) and the^^ 
■results reported by the schools. Typically, the 
more measurable the objective, the greater the 
incidence of attainment. School personnel who 
lacked the skills to prepare measurable objectives 
generally also had great difficulty in reporting the 
results of Jheir programs. Since ECE's legislatively 



Table 9 

Students Tested in ECE Reading/Language 
Development, by Funding Sourpe, 1973-74 





Students tested 


Funding source 


Number 


Percent of total 


ECE/Titlel/SB90/Other* 


35714 


26.6 


ECE/Titlel/SB90 


30779 


22 9 


ECE/Title 1 


22,484 


167 • 


ECE 


21,132 


15.7 


ECE/Title I/Other* 


15,171 


11.3 


ECE/Other* 


5,955 


4.4 


ECE/SB90 


2,288 


1.7 


ECE/SB90/Other* 


947' 


.7 


Total 


134,470 


100.0 



*"Other" includes MiUer-Unruh, bilingual education, and Indian 
early childhood educalion 



__4ized ndrm-referenced achievement tests for 
pretest and post-test corTiparisons of achievement 
relLlts. Schools not' receiving any funds for disad- 
vantaged children were peimitted to use criterion- 
referenced measures for achievement. 

'in those ECE schools using normative stand- 
ardized achievement measures, months of gain in • 
rea^ding skill per month of instruction were com- 
pujted for students in grades one, two, and three. In 
computing gain scores, only those students were 
included for whom both pretest and post-test data 
were available. 

Test results revealed that, with an average 
of seven months between the pretest and the 
post-test, those pupils in schools receiving ECE 
,funds typically attained 1.1 months growth in 
reading achievement for each month of instruc- 
tion. (See Table 13.) Previous evaluations of 
specially funded program^ have indicated t})at 
.7 month of growth" per month of instruction 
was typical for disadvantaged children. The av- 
erage child, with no special instruction, should 
gain 1.0 month per month of instruction. Anal- 
ysis by grade level and funding source were 
made, and results indicated that certain combina- 
tions of funding sources were more successful that 
others in producing growth. Programs were ranked 
by funding source and by student gain between 
pretest and post-test. Thes* data are presented in 
tables 14, 15, and 16 and show that when an ECE 
program was combined with either ESEA, Title I, 
funded programs or ''Other" (usually Miller- 
Unruh), the greatest gains were realized for ECE 
participants in combined programs. Lesser gains 
were realized when ECE programs were combined 
with selected educationally disadvantaged pro- 
grams, such as the educationally disadvantaged, 
youth program (SB 90). However, gains in the 
combined programs, with minimal state monitoring 
and no requirement to submit plans pr annual 
^evaluations, fell below the 1.1 month level of 
growth only in grade three. 



Programs such as ECE with the riiost descrjptiv 
and w pU-^efmed guidelines, program audits, 'and 
spiecifi^ objectives have a better chance of pro- 

I I ^ Table 11 - , 

Classroom Strategies Most Frequently Reported 
by Succ^ful Reading/Language Development 
Programs in ECE Schools, 1973-74 



Rank 



Classroom managftrpent 
strategy used 



Diagnostic/prescriptive materials 
individualized instruction within 

regular classroom 
Instructional aides 
Commercially developed instruc* 

tional materials , . ' - 
Reading lab centers 



Percent of 
successful* . 
schools reporting 



62.1 , 

40.8 
327 

16,9 
16.9 



* "Successful" refers to programs whose objectjves were either 
exceeded, attained, or partially attained. * 

table 12 

Evaluation Tools Most Frequently Reported by ■ 
Successful Reading/Language Development 
\ Programs in ECE Schools, 1973-74 



\ 




Pefcent of 
successful* 


Rank 


v Type of evaluation 


schoolsrepdrting 




Two or more norm-referenced 






'Standardized tests ^ 


39.3 


2 


Two or more norm-referenced 
standardized test^ with locally 
developed criterion-referenced 






tests . 


12.7 


3 


•Two or more norm-referenced 
tests with comffiercially devel- 






oped criterion-referenced tests^ 


10.7 ^ 


4 


One norm-referenced standard- 


9\6 




ized test 



♦"Successful" refers .to programs whose objectives were either 
exceeded, attained, or partially attained, ' 



^ Table 13 

Average ECE Student Progress in Reading/Language 
Componeht, 1973^^74 



Grade level 


Nusnbei'^of students tested 


Average grade 
equivalent score 


Average months of gain 
per month of instruction^ * 


Pretest 


Post-test 


One 


14,716 


1.1 


1.9 . 


^ 1.1 


Two 


30,982 


1.7 


2.5 


1.1 


Three 


28,803 


2.4 


3.3 


1.1 



*An average of seven months elapsed between pretest and post-test. 



0 0 023 
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Table 14 

Average Grade One ECE Student Progress in the Reading/Language 
Component, by Funding Source, 1973-74 





• 1 


Average grade equivalent score 


Average months of gain 
per month of instruction' 


^ Pretes^t 

1 


Post -test 


ECE/Title l/Othert 


1,818 


1.1 


2.0 


1.3 


ECE/T.tlel/SB90/Othert 


2,930 


6.9 


• 1.8 


' 1.3 


ECE 


2.402 


1.2 


2.0 


1.1 


ECE/Title 1 


3,251 


1.1 


1.9 


' 1.1 


ECE/SB90 


269 


i.d 


'1.8 ' 


.1-1 • 


EC^/Other> 


330 


1.2 


2.0 


*1.V 


ECE/Titlel/SB90 


3,716 


. 1.0 


^ 1.7 


1.0 


Total 


14,716 








Average for all sources 




1.1 ^ 


1.9 


1.1 



*An average of seyen months elapsed between pretest and post-test. 

f'Othcr" includes MiUer Unruh, bilingual education, and Indian education. Miller-Unruh programs represent the majority. 



' Table 15 

; Average Grade Two ECE Student Progr^s in the Reading/Language 
' • .Component, by Funding Source, 1973-74 



Funding source 


Number of students tested 


Average grade equivalent score 


^ Average months of gain 
per month of instruction* 


Pretest 


Post-test 


ECE/Othert 


1,325 


2.0 


^ : 3.0 ^ 


1.4 


ECE. 


4^06 


2.1 


3.0 


1.3 


ECE/Title 1 




1.8 


2.7 


1.3 


ECE/SB90 4 


520 


1.5 ^ ^ 


. r2.3 


1.1 


ECE/Title l/Sa 90 


7,248 


. 1.6 


2.4 


' ' l.t : 


ECE/Title lyOtKert 


3,334 


1.7 


2.5 


1.1 


ECE/Titlel/SB90/C|thert 


9,582 ' — 


\i:6 


' , -2.3 


1.0 


Total 


30,992 








, Average for all sources 




1.7 


2.5 


1.1 



*An average of seven months elapsed between pretest and post-test, ^ ^ 

t'*Other" includes Miller-Unruh> bilingual education, and Indian education Miller-Unruh programs represent the majority 



Average Grade Three ECB^Studej^Progr^'in Beading/Language 
Component, by Funding Source, 1973-74 



I 

Funding source 


<- 

Number of students tested 


Average grade equivalent score 


Average months of gam 
per month of instruction* 


Pretest - 


Post-test 


ECE/Othert 


1,153 




3.1 


4.0 


1.3 


ECE/Title l/Othert 


3,282 




^2.3 


3.2 . 


1.3 


ECE 


4,215 




3.1 


3.9 f 


1.1 


ECE/Title 1 


3,559 




2.5 


3.3 


1.1 / 


ECE/Title I/SB 90 


6,711 




2.3 


3.1 


1.1 


ECE/Title I/SB 90/Othert 


9,308 




2.2 


, 3.0 


1.1 


ECE/SB90 


575 




2.4 


3.1 




Total 


28,803 








Average for all sources 


X 


2.4 


3.3 * 


1.1 



average of seven months elapsed between pretest and post-test. 
t"Other'* includes MiHcr-Unruh, bilingual edflcation, and Indian education. Miller-Unruh programs represent the majority. 
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ducing'posilive results than programs without these 
requirements. * . ' ' 

Data obtained from the state assessment pro- 
gram on'the performance of third ^ade students in 
the spring, 1974, were analyzed for schools con- 
ducting ECE programs. When the state assessment 
data, as shown in Tabje 17, were statistically 
adjusted to account for predicted levels of achieve- 
ment (including socfoeconomic status, bilin- 
gualism, and mobility) and variations in beginning 
scores, the analysis showed that the rankings of 
programs by funding source were substantially the 
same as those indicated by the data submitted' by^ 
the ECE schools. 

Table 17 

ECE Program Test Results as Compared to 
1974 State Assessment Program 
Results, by Funding Source 





Rank order 




School 






evaluation 


State Assessment * 


Funding source 


reports 


program results 


ECE/Miller-Unruh* 


1 


1 


ECE 


2 


2 


ECE/Title 1/ 






,MiHer-Unruh 


4 


3 


ECE/Title 1 


6 


-4 ^ 


ECE/Title 1/ 






SB90/Miller-Unruh ' 


5' 


5 


ECE/Title I/SB 90 


3 


6 



* *Othcr" in district evaluation reports 



Analyses were also made for students in kinder- 
garten and grades one, two, and three to determine 
the shift in percent of students scaring 'in each 
quarter of .the distribution in terms of national., 
norms.. Jn computing the percent of quartile 
movement, test *data for all students were/used, 
with the assumption that although studenj/^^opula-^ 
tions would shift between the pretest and the 
post-test, student, characteristics (such as socio- 
economic status, bilingualism, and so forth) would 
remain substantially the same. Consequently, the 
number of students included in the computation of 
gain scores (tab||p 13, 14, 15, and 16) differs from 
the number of students included in determining 
percentage shifts in each quarter Df the distribu- 
tion, (See Table 18.) Analyses of'gains for students 
in kindergarten ^nd grades one, two, and three 
showed there was a decrease of 13 percentage 
points for the students scoring, in the lowest 
quarter of the distribution. There was an increase 
of 9 percentage points in the upper quarter of the 
distribution, while the second and third quarters 
remained about the same. > 

Test information reported by districts which was 
either incomplete or contained procedural irregu- 
larities was npt aggregated with statewide results. 
Incomplete data or irregular procedures, included 
instances in which: (1) either pretest or post-test 
information was omitted; (2) test results were not, 
given in gfade equivalents; (3) test results were • 
combined. for several grade levels; (4) the standard- 
ized measure used ip the pretest^differed from the 
one used in the post-test; (5) nonstandardized tests 
w8te used; or (6) no test results were reported. 



Table 18 - 

Number of ECE Students Tested and the Distribution of Reading/Language 
Development Achievement Scores at Pretesting and 
Post-testftig, 1973-74 



Gradelevei 


Number 
of students tested 


Tesf . 


Percent of students scoring in each quartile 


First 


Second 


Thjrd 


Fourth 


Kindergarten 


16,583 


r ' Pre 


33.3 


26.8 


22.2 • 


17.7 




- 28,583 . 


Post 


14.2 


19.7 


24.9 


41.2 


One 


21,495 


Pre , 


46.8 


20.4 


17.0 


15.8 




40,643 


Post 


26.4 


25.9 


22.6 


25,1 


Two 


23,998 


Pre 


38.4 


. 32.0 


18.5 


'11.1 




33,883 


Post 


31.5 


30.4 


• 20.9 


J7.2 


Three 


22,156 


Pre 


46.9 


• 27.7, 


15.1 


10.3 




31,918 


Post 


^.4 


26.4 


20.6 


14.7 



ERIC 
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Mathematics Component 

/;/ the matheviatiLS lumponent, the athievetfieJit test, . 
scores shoM'ed an average gain oj L2 months of 
growth per month of mstnu tion m grades one 
through three. The' expect cJ growth is one month oj 
growth per month of instruction for the average 
student and 7 month for disadvantaged students, 

Tlie mathematics component was directed to- 
wards enhancing the mathematics instruction 
among all student participants by encouraging the 
restructuring of mathematics programs through the 
use of materials and resources provided in the early 
childhood education program. 

Participation in Mathematics instruction 

A total of 1 22,61 1 students in kindergartetrand 
grades one, two, and three were tested in mathe-' 
matics^ instruction activities in schools with ECE 
programs. (See Table 19.) Most ECE participants 
were served in schools having other state and 
federally funded programs. The fiumber and per- 
cent of students tested by funding* sotirce are 
presented in Table 20. 

, ' ^'^^ Table 19 

Number and Percent of Students Tested in E,CE 
Mathematics Programs, 1973-74 p 



Grade level 


ECE students tested 


Number 


^k^ent 


Kindergarten 

One 

Two 

Three ^ 


25,060 
36,069 . ' 
30,676 
30,806 


20.5"\ 
29.4, 
25.0 
25.1 


Total 


122,611 


. 100.0 



Objectives, Activities', and Findings 

More than 75 percent of the schools' evaluation 
reports contained nrfeasurable objectives relating to 
the development of mathematics skillsSObjectives 
were most frequently stated in terms of the increased 
academic progress or in terms of months of growth 
per month of instruction, as determined^by norm- 
reffcrenced standardized acliievement tests. 

Analyses Were made of the measurable quality 
of program objectives (as determined by Depart- 
ment evaluation consultants) and the results 
reported by the schools. Findings indicated that 
the raore measurabje the objective the greater the 
incidence of determinable program success.- 
Schools having projects^with nonmeasurable objec- 
tives reported more results that were not directly 
related to stated program goals. '(See Table 21 .) 

Table, 20 , >^ 

Number and Percent of Students Tested in ECE, 
Mathematics Programs and Percent Supported 
by Each Funding Source, 1973-74 



Funding source 


ECE students tested 


Number 


Percent 


ECE7Ti:^lel/SB90/Other* 


31,918 


26.0 


ECE/Tjtlel/SB90 


27,899 


22.8 


ECE/Title 1 


21,144 


17.2 


ECE 


. 20,21 1 


16.5 


ECE/Title I/Other* 


13,920 


11.4 


ECE/Other* 


4,308 


3.5 ' 


ECE/SB90 


2,248 


1.8 


ECE/SB90/Othe'r* 


9.63 


.8 


Total , i' 


1^2,611 


100.0 



*"Other** includes Miller-Unruh, bilingual education, ^nd Indian 
eajjy childhood education.,- 



Table . ' ' 

Quality of ECE Schools Objectives iniMa^ematics Programs 
for Six Types of Results Reputed, 19i73-74 







Average quality of schools' objectives, by percent 

=^ a_ 1 


n 








Vague but 




Number 


Types of results reported 




Measurable* 


measurable* 


Nonmeasurable* 


of schools 


Exceeded objective 




38,2 


61^8 • 


0.0 


89 


Attained objective 




/- 46.2 


53.4 


0.4 


234 


Partially attained objective 




45.8 ' 


53.4 


0.8 


131 


Did not attain objective ^ 




50.0 


42.9 


7.1 ' 


42 


Results not attained 




39.2 


48.1, 


' ' 12.7 


7a' 


Results not related to objective^ 




16.0 


20.5 


63.5 


326 


Total schools 








901 . ^ 


Average percent 


34.0 


41.4 


24.6 




■ Q J ' 1- K 


75.4 5 

^ rJ 







♦As determined by Department staff. 
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An analysis , was made of the types of activities 
in* mathematics instruction most frequently 
reported in use by the 454 ECE schools which 
either exceeded, , attained, or partially attained, 
their stated objectives. The report on these 
activities is presented in Table 22. 

The variety of activities reported by schdols for 
improving student performance in mathematics 
suggests that ECE schools have gained from their 
experiences with other local, state, and federally 
funded programs. 

ECE schools used a variety of procedures for 
evaluating- their mathematics programs. The most 
frequently reported activities successful in helping) 
schools assess mathematics progress are reported in 
Table 23. The findings for mathematics are similar 
to those in language development: Norm-referenced 
standardized tests and locally developed criterion- 
referenced- tests were used in mqre than two-thirds, 
of the ECE schools. ' ^ 

In the 901 ECE schools usi;ig standardized tests, 
average months of gain in mathematics per month 
of instruction were computed for students in 
grades one, two, and three. In determining months 
of gain, only those students were included for 
whom >both pretest and post-test scores were 
available. 

Results indicated that, with an average of seven 
months between pretest and posfr^est, students in 
grades one, two, and three typically gained 1.2 
months or more in measured mathematics skills for 
each month of instruction. (See TaMe 24.) 

Table 22 

Activities Most Frequently Imported by 
Successful MatUfS^atics Programs 
in ECE Schools, 1973-74 





Olassroom nfenagement 


Percent of successful* 


Rank 


/ strategy used ^ 


schools reporting 


1 


Instructional aides \ 






to reinforce - \ 






teachep instruction 


48.2 


2 


Whole class instruction 


32.6 


3 


Individualized instruction 






within the regular 






classroom . 


30.0 


4 


Use of parent 






volunteers 


26.4 


5 


'Related staff" 






inservice training 


22.9 
— — * — 



^al51e23 ^ j 

Evaluation Tools Most Frequently Reported by 
Successful Mathematics Programs 
in ECE Schools, 1973-74 



Rank 


Type of evaluatipn 


Percent of Successful * 
schools reporting 


1 


Two or more norm-referenced 






standardized tes>s 


46.7 


2 


One norm-referenced J 






standardized test 


13.0 


3 


Two or more norm-referenced 






standardized tests with 






locally developed criterion- 






referenced tests 


. 11.0 



"SucccssluP* refers 1o prftgranis whoso object aes were either 
exceeded, dttdincd, or partially attained 



♦"SuccessfuP* referr^1t>^programs whose objectives were either 
exceeded, attained, or partially attained 



Analyses by grade fevel for eacli of the several 
funding sources revealed that programs served by 
certain combinations of funds attained greater 
results than did others. (See tables 25, 26, and 27.) 

Analyses were also conducted for students in 
kindergarten and grades 'one, two, and three 
regarding the ' percent of movement out of the 
lower^quarters and into the higher quarters of the 
distribution of mathematics achieve^ment scores. 
Findings summarized in Table 28 indicate that 
there was a 1 6 percent reduction of students in the 
lowest quarter of the distribution and an increase 
of more tiian 12 percent in the highest quarter.^ 
Changes in the second and third quarters of the* 
distribution were/airly small. 

In computm^he percent of quartile shift for'*' 
schools reporting in those terms, test data for all 
students were used with the assump-tion that 
student population ciiaracteristics such as socio- 
economic status, bilingualism, and so forth ^ould 
remain similar regardless of pupil mobility. As a 
result, the number of students includjsd in the, 
analysis of gain scores differs from tiie number of 
students included in computing percentage, shifts. 

Test information reported by districts whicji was 
either incomplete or contained procedural irregu- 
larities was not aggregated with statewide results. 
Incomplete data or irregular procedures included 
instances in which (1) either pretest or post-Jest 
information was omitted; (2) test results were not 
given in gr^de equivalents; (3) test results were 
combined foiv several gracle levels; (.4) the standard- 
ized measure used in the pretest differed from the 
ineaSure used the post-test; (5) nonstandardized 
tests were usetl; or (6) no tests results wererreported* 
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Table 24 



Average Mathematics Achievement by ECE Students, 1973-74 



r 


' Number 


Average grade 


Average months of gain 


Grade 


of students 


equivalent score 


Between pretest 
and post-test 


Per month 
of instructfon* 


. level 


testftj 


Pretest 


Post-test 


One 
Two • 
Three > 


" 14,660 
26,904 
^24,397 


1.1 

^ 1.8 
2.5 


1.9 

V 
3.4 


8 
9 

9 , 


1.2 > 

1.3 • 
1.4 



*An average of^ven months elapsed between pretest an(^ post-test. 



Table 25 

Number oA Grade One ECB Students Tested and the Average Mathematics 
- * Achievement, by Funding Source, 1973-74 





"Number 


Average grade 


Average months 




of students 


equivalent score 


of gam per month 


Funding source 


tested 


Pretest 


• Post-test 


of instruction* ' 


ECE/SB90 ' 


268 


0.9 . 


1.9 


1.4 




2,444 


1.2 


2.1 


1.3 


ECE/Title 1 


3,186 


1.1 


2.0 


1.3 


ECE/Othert 


390 


1.2 


2.1 


1.3 


*ECE/Titlel/SB90 


3,716 


1.0 


1.7 


1.1 


ECE/Title l/Othert 


1,673 


1.1 ^ 


: 


1.1 


ECE/Tltlel/SB90/Othert 


2,983 


1.0- 


fl 


i.o 


Total 


14,660 








Average for all sources 




1.1 


'1.9 


1.2 



*An average of seven months elapsed between the pretest and the post-test. 

t*'Other** mcludcs Miller-Unruh, bilingual education, and Indian early childhood education. 



Table 26 



Number of Grade Two ECE Students Tested and Average^athematics 
Achievement, by Funding Source, 1973-74 





Number 
of students 


Average grade 
\ equivalent score 


* Average months 
of gain per month 


Funding source 


tested 


Pfetest 


Post-test 


^ of instruction* 


' ECE/Tkle 1 


4,301 


1.8 


2.8 


1.4 


ECE/Othert 


924 


. 2.0 


3.0 


1.4 


ECE/Title l/Ottiert 


2.976 


1.7 


2.7 • 


. 1.4 ^ 


ECE 


4,363 


2.1 


3.0 


1.4 


ECE/Title I/SB 90 


6,183 


1.6 


2.5 ; 


1.3 


ECE/Title I/SB 90/0thert 


7,678 , 


1.6 


2.5. 


1.3 


ECE/SB90 


479 


1.5 


2.3 


1.1 


Total 


26,904 








Average for all sources 




1.8 


2.7 


' 1.3 



*An average of seven months elapsed between the pretest and the po<t-test. 
, t**Olhe'r" includes Miller-Unruh, bilingual educatibn, and IndfeffeSl/ childhood etiucation. 



0 0 0.2 « 



Table 27 



Number oi Grade Three ECE Students Tested and-Average Mathematics 
Achievement, by Funding Source, 1973-74 



Funding source 


Number 
of students 
tested 


Average grade 
equivalenUcorg^^-— 


Average months'^ 
ofyain-per month 

Ul MlairULllUil 


Pretest 


Post -test 


ECE/Othert 
ECE 

ECE/Titlel / 
• ECE/Titlel/SB90 
ECE/Thlel/Othert 
ECE/^ritlel/SB90/Othert 
ECE/SB90 


81^ 
3,832 
3,251 
5,601 
2',857 
7,485 
' 555 


2.9 
. 2.9 

2.5 

2.3 > 

2.4 

2.4 
.2.5 


4,0 ' 
3.9 
3.5 
3.3 
3.4 
3.3 
' 3.1 


1.6 
1.4 
1,4 
1,4 
1.4 
1.3 
.9 


Total 


24,397 








Average for all sources 




2.5 


3.5 


1.4 ^ 



- ^ 

*An average oi seven months elapsed between the pretest and the post-test 

t"OUicr" includes Miller-Unruh. bilingual education, and Indian early childhood education J 



Jable28^^A 

Distribution of ECE Student Mathematics Achievement Scores 
at Pretesting and Post-testing, 1973-74 



Grade level , 


■ Number 
of students 
tested 

9 


• Test 


Percent of students scoring m each quartile 


First 


Second 


Third 


Fourth 


Kindergarten 


1B/33P 


' Pre 


. 34.6 


* 27.2 


20,4 


17.8 




25,936 


Post 


17.1 


26.2 


24,3 


32.4. 


One 


21,211 


Pre 


42.7 


27.9 


16.3 


13.1 




36,021 


Post 


24.0 


23.6 


24.1 


28.3 


Two ' 


205033 


Pre 


39.9 


27.8 


21.2 


11.1 




29,752 


PC3t 


26.2 


28.8 


20.9 


24.1 


Three 


18,163 


Pre 


49.4 


25.2 


15.3 


10-1 




\ 30,020 


Post 


/35.4 


28.5 


19.9 


16.3 



Health/Auxiliary Servi^es^Component 
Health/auxiliary services were reported as effective in 
providing health examinations and received an above 
^y^5 percent effecf ivje overall rating. 

Health services are those required as a result of 
the comprehensive health needs assessment within 
the early childhood education school. This com- 
ponent must "ialso include auxiliary services, such as 
pupil personnel services, and library and media 
^^erviees4n multifimded schools. 

Objectives and Activities 

v.. The major auxiliary services objectives reported 
were^related to providing health services, pupil 
personnel services, and referral services in ECE 



schools. The specific objectives^ reported most 
frequently included providing health examinations, 
improving school attendance, providing health 
information, and improving the personal health of 
the participants. Other major objectives focused on 
improving pupil attitudes, providing library and 
medi^ services, and improving academic achieve- 
ment. 

Specific activities were emphasized in each of 
the auxiliary services provided, such as psychologi- 
cal services, health examinations, and general 
services within the library and media services. 

Evaluation of Health/ Auxiliary Services 

A direct relationship exists between the fre- 
quency of activities listed in objectives and their 
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importance, as rated by school personnel. Schools 
were asked to' do two separate ratings, one of 
effective activities and one of important activities. 
These rankings were compared to evaluate the 
relationships between the rankings. Auxiliary ser- 
vices usually are evaluated .by identifying the 
criteria for a successful program and assessing the 
level of th^ effectiveness of specific ^services in 
meeting those criteria. Seventy percent of the 
evaluation reports stated the criteria in ^terms of 
the amount or number of services proyid^d. .Only 
30 percent reported criteria^ related to-' expected 
changes in pupil or staff behavior or performance. 
The most frequent ^criterion for effectiveness was 
the number of health examinations given. 

The level of effectiveness was determined pri- 
marily by three evaluation methods: subjective 
judgment by staff, counting of participants or 
activities, and objective measurements. The analysis 
of the school reports showed that 47 percent of 
the sen'ices were evaluated subjectively and 42 
percent by enumeration data. The remaining 1 1 
percent of the health/auxiliary services were eval- 
uated by objective measurements such as rating 
scales, 

Tlie results reported in the auxiliary services 
component generally related to the stated objec- 
tives. Of the schools reporting measurable objec- 
tives, 41 percent had attained their objectives, 30 
percent achieved part of their objectives, 3 percent 
did not attain their objectives, and 26 percent 
reported results unrelated to their objectives. The 
reports rated the level of effectiveness of specific 
services in temts of meeting their school objectives. 
Pupil personnel services were 77 percent effective 
or very effective. Health services were rated 79 per- 
cent effective or very effective, and library services 
ratings were 85 percent effective or very effective. 

A comparison was made between the impor- 
tance and effectiveness of the major services 
provided. The results are shown graphically in 
figures 1 , 2, and 3. The greatest difference between 
importance and effectiveness was seen in two 
specific services. Library and media materials 
ranked high in effectiveness but low in importance, 
and medical services ranked low in effectiveness 
but high in importance, 

• Positive results submitted in relation to the 
stated objectives are summarized in Table 29-based 
on data submitted by schools and measurable 
performance objectives. It is evident that auxiliary 
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services were effective in ECE programs. Tliis 
effectiveness was determined from. the resulting 
improvement noted in pupil health, pupil attitudes, 
and improved school attendance. 

The major recom.mendations made in the reports 
for health/auxiliary services in g^ral were to 
qontinue the present progranl, improve communi- 
cations, provide additional services, increase parent 
involvement, improve program objectives, and pro- 
vide inservice workshops. 





Five most 
important 


Five least 
important 


Five mosl 
effective 


Psychological testing 
Speech therapy 
Individual counseling . 
Parent counseling 


Teacher conference 


Five least 
effective 


Welfare and attendance 


Psychometric help 
Guidance inservice 
Home counseling 
Group counseling 



Figure 1. Relative importance and effectiveness of ten 
major pupil personnel services in ECE schools, 
1973-74 





Three most 


Two least 




important 


Importarrt 


Three most 


Media centers 


Materials 


effective 


General services 




Two least 


Personnel 


Mobile centers 


effective 







Figure 2. Relative Importance and effectiveness of five 
major library and media services, as reported by 
^i^, ECE schools, 1973-74 





Four most 
important 


Three least 
important 


Four most 
effective 


Nursing 
Diagnostic 


Nutrition 
Health education 


Three least 
effective 


Dental 
Medical 


Family services 



Figure 3. Relative importance and effectiveness i>i seven 
major health services, as reported fiy 
schools, 1973-74 ' 
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. Table 29 > 

Health/ Auxiliary Services Program Objectives Most Frequently Attained 
in ECE Schools, 1973-74 



Schools 
rank order 



1 
2 
3 
4 
5 
6 
7 



^ Objective attained 



Provision of health services 
Provision of physical examinations 
Provision of pupil personnel services 
.Provision of referral services 
Improvement in participants* health 
Provision of meals and snacks 
Employment of auxiliary services personnel 



Percent of successful* 
schools reporting 

38 
33 
22 
17 
11 
10 
10 



'SuccisJful refers to programs whose objectives were eilher^xceected, attained, or pariiaily attained. 



Parent Education Component 

Parent education objectives usually related to, ex- 
pected changes in behavior and performance of 
parents, with an increase in skills and knowledge most 
' often reported. 

The parent education component required spe- 
cific objectives and activities that would increase 
parent effectiveness 'by encouraging parents to 
become an integral part of the formal education 
process. 

' Eighty-seven percent of the major objectives 
reported for the parent education component were 
well defined, and 13 percent of the ol)jectives were 
vague. Of the well-defined objectives, 61 percent 
were related to expected changes in behavior and 
performance of the parents^ and 39 percent of the 
objectives concerned services provided by district 
or school staff. 

Of the objectives related to expected changes in 
behavior and performance, reports by most schools 
concentrated on increased skills and knowledge of 
child growth and'development by parents, increased 
program participation by parents, and more paren- 
tal understanding and support of the school program. 

Of the objectives related to serviced provided, 
the most frequently reported objectives were to 
provide for orientation sessions and parent classes 
and workshops to train parents for effective 
participation in school and class activities. 

The most important activities reported were in 
the same general areas as the stated objectives: 
increased participation, instructional programs for 
parents, school activities, {parental knowledge, and 
support of t|je education pjocess through parti- 
cipation. 



" In a fe^ school reports there were indicatiojis 
that the content of the proposed parent education 
component h^d. 6^en.^^changei<J. The reason was 
usually that the objectives^had been predetermined 
by project personnel an3 after parent surveys had 
been conducted, the programs were redesigned to 
meet the parents' stated needs. 

Parent education activities were evaluated by 
identifying the criteria for a successful program 
and assessing the level of effectiveness of speciific 
activities in ^meeting those criteria. In the schools 
that reported evaluation, 63 percent stated criteria 
related to expected changes in parent behavior, and 
37 percent of the criteria related to services 
provided by the project staff. Tne most frequent 
criterion mentioned, was parent opinion. Objective 
measurements, such as student and parent tests and 
questionnaires, accounted for 12 percent of the 
school evaluations. 

Schools reporting well-defined objectives reported 
achieving 89 percent of the objectives related to 
expected changes in parent behavior. (See Table 30.) 
For objectives related to provision of services, the 
achievement was 67 percent. Two percent of all 
measurable objectives were unachieved, and 21^ 
percent of all reported results were unrelated to 
the stated objectives. 

In addition to listing the most important 
activities related to achieving stated objectives, 
each school also rated the level of effectiveness of 
the activities. The mdst important activities listed 
by the schools w^e rated by program personnel as 
the most effective. These were instructional classes 
foT^ parents, particip^^tion in school activities, and 
t)arent-teacher ^conferences. Th^ activities ton- 
sidered least important were rated as least effec- 

0 0 all ■ ' 



Table 30 

Most Frequently Reported Parent Responses to 
Parent Education Activities, 197f374 







4. - 

Percent of successful 


rank order 


Parent response 


schools reporting 




Increased their understanding and support 






^ of the program 


^ 29 


2 


Attended scheduled classes and workshops 


17 


3 


Participated m parent education 






activities 


15 


4 


Increased their knowledge and skills 


12 


5 


Visited sthool and participated 






irt school activities 


10 



"SuccesstuI" refers to programs whose objectives were either exceeded, atfaihed/or partially attained 



tive. Figure 4 shows the'' relationship between the 
importance and effectiveness of activities as 
reported. 

The recommendations made in>tje parent educa- 
tion component indicated the nee^to improve 
conimunication\between the homes ancK^e school. 
Oiher recommendations were for additiohal classes 
for parents and fo^ activities based on the needs of 
parents: -JQie. expa3;ision of the parent education 
comppnent by offering parent§ iT|ore opportunities 
for. participation ancr niore ^variety in the types of 
participatioihAvas also recommended. 





^Tt^ree Qriost 
important 


Two least 
important 


Three most 
effective 


Instructional classes^ 
Participation in sttnx)j 

activities * 
Parent-teaphei^ 

conferences 




Two least 
effective 




P^ren^ meetings 
^rografn, yWe/itation 



Figure 4. Relative^ Importance and effectiveness of five 
major parent education activities in -£CE;,schooU', 
1973-74 



Parent Participation and Community - 
Involvement Component : ; , 

Parent involvement activities rated most effective 
were parent- teacher conferences, advi^nry committee 
meetings, school-parent meetings, use of parent 
volunteers, and home communication. 

The parent participation and community 
involvement component required specific plans for 
the improvement of communication between the 



schools ajid the community as well as parent 
participation in the planning, implementation, 
modification, and evaluation of the program and in 
the classroom education of the children. 

In the early .childhood education program, use 
of parents in tKe classroom was repoi^rf as one of 
the measurable major objectives/Other objectives 
were: to increase parent visits to the classroom, to 
recruit parent assistants, to identify community 
resource personnel, to improve attendance at 
school activities, and to increase parent involve- 
ment in planning, implementation, and evaluation. 

Of the objectives related to services provided, 
the major ones reported most frequently by 
projects were dissemination of program informa- 

• tion, program orientation, and home-school com- 
munication. 

Three of the major objective areas reported by a 
large number of schools were reflected in the most 
important activities listed. These were program 

* orientation, parent visits to schools and classroom, 
\and attendance at school functions. 

\ Parent involvement activities were evaluated by 
io^entifying the criteria for a successful program 
an^ assessing the level of effectiveness of the 
specific services provided. Sixty-six percent of the 
evaluations related to expected changes in parent 
\ behavior. Thirty-four percent of the criteria related 
to serviqes provided by the project staff. The most 
frequent criterion used tb measure effectiveness^ 
was the number of parents participating. . 

Of tlje evaluation methods used„47 percent was/ 
enumeration' of participants and activities, and 39 
percent was subjective judgment. The rdfmaining 14 
percent was objective measurements, usually in the 
form of parent questionnaires, rating scales, or 
attitude scales. 
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In the parent involvement component, 52 per- 
cent of the schools achieved their objectives. 
Nineteen percent achieved part of their objectives, 
17 percwt reported negative results, and 12 
percent reported results not related to their objec- 
tives. 

The school reports rated the level of the 
effectiveness of major activities in terms of meetipg 
school objectives. Parent involvement activities 
were rated mostly as effective or very effective. 
The most effective activities were parent-teacher 
^ coifferences, advisory committee meetings, school- 
parent meetings, use of parent volunteers, and 
Tiome-school coipmunication. The least effective, 
according to school ratings, were cultural pro- 
grams, baby-sitting services, home calls and visits, 
•and planning sessions. 
^ A comparison was made between the relative 
importance and effectiveness of the major parent 
involvement activities. The results are summarized 
in Figure 5. 

The results of parent involvement most fre- 
quently reported are summarized in Table 3 1 , This 
table includes only the specific Outcomes indicated 
by the schools which reported results related to 
their stated objcctives.^^ Parent involvement 
activities most frequently resulted in ^increased 
time spent by parents as volunteers and aides, 
increased participation in school activities and 
meetings, involvement in program planning, imple- 
mentation and evaluation, a better response to 
communications from school, better attendance at 



parent-teacher conferences, and a positive attitude 
taken by parents and students. 

Of the recommendations made by the schools, 
34 percent cited the recruitment and training of 
parent volunteers and aides to work at the school 
site; and 22 percent stressed the. need for .more 
effective communication between the school and 
the home. Frequent mention was made of th^ need 
f4r a liaison person to assist in this area. Other 
recommendations suggested increases Ln the num- 
ber and variety of activities afforded to parents as a 
way to increase school participation and to increase 
the parents' involvement in the design and 
implementation of the school plan. The use '^of 
bilingual staff in the community was also recom- 
mended. 





Five most 
important 


Four least 
important 


Five most 
effective 

m 


Parent-teacher sessions 
Advisory group meetings 
School-parent meetings 
Use of parent aides 
Communications with 
the home 




Four feast 
effective 




Cultui^l programs 
Child care service 
Planning sessions 
Home calls, Visits 



Figure 5. Relative importance and effectiveness of nine 
parent involvement activities provided by ECE 
schools, 1973^74 



Table 31 

Effects of Parent Involvement Reported by ECE Schools Whose Results 
Related to Stated Objectives, 1973*74 



Schools 




Percent of successful * 


rank order 


Parent response 


schools reporting 


1 


Spent more time as a volunteer or^aide 


18 


2. 


Participated more in school activities 






and meetings 


16 


3 ■ 


Became involved in prpgram planning, 






implementation, and evaluation 


9 


4 


Responded to communications from school 


9 


5 


Attended parent-teacher conferences 




> 6^ 


^ Along with students expressed 






a positive attitude 


8 



'•Successful*' refers to programs whose objectives were either exceeded, attained, or partially attained. 
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Staff Development and Inservice 
' Education Component 

The \mff development romponent results reported 
most frequently indicated a grater use of individual- 
ized » instrucnon, better organization of inservice 
training, and improvement in writing and instruc- 
tional objectives. 

Staff development and inservice educatioa,were 
requirea jfof all schools conducting an early chiW- 
' hood eaucation program. Objectives and activities 
that would lead to improved performance by 
professidr^aL and nonprofessional personnel work- 
ing in tne program were included in each school 
plan. Thfeae activities served 27,105 persons in the 
early chiMhood education schools. 

Ojjjectives and Activities 

The major staff development objectives 
established in early childhood education schools 
were rela^ied to the improvement of teaching 
techmques. Measurable performance objectives 
were recoi]ded by 72 percent of the schools, while 
relatively vague objectives were reported .by 28 
percent of the schools. The well-defined objectives 
included a description of expected changes in the 
performance^ level of participants or in the services 
to be provided by district or school staff. Specific 
objectives included: improvement in individualized 
instruction and use of diagnostic/prescriptive tech- 
niques, improvement in writing instructional objec- 
tives, ai\d improvement in planning other objectives 
related \o the number or type of personnel to 
receive training. 

The typ^ of activities piovided to attain objec- 
tives included schooMevel workshops on instruc- 
tional methods and content, staff meetings, school 
or classroom visits, district and county workshops, 
college courses, conferences, and demonstrations. 
Content areas covered during inservice training 
activities included jeading, mathematics, language,, 
and general curriculum.. Relatively few schools 
reported inservice activities tiiat were related to the 
needs assessment, schooUeVel planning, volunteers 
or tutors, parent involvement, or parent education. 

Evaluation and Results / 

Evaluation criteria used to measure the effective- 
ness of staff development and inservice activities 
were related to these activities two out of every 
three times. About one-third of the schools men- 
tioned classroom implementation by teachers as an 
evaluation criterion. Subjective judgments made up 
67 percent of the methods by which the activities 



were evaluated, while 20 percent were based on 
objective measurements, Tliirteen percent related , 
program effectiveness to enumerative criteria. 

In 87 percent of the ECE schools, respondents 
indicated that their major objectives were attained. 
Six percent of the schools recorded that objectives 
were partially attained, while 5 perceiit of the 
schools recorded results not related to stated 
objectives. Two percent of the schools indicated 
that their objectives were not attained, or fbey did 
not include any data on this component. 

Comparisons were made between* the impor- 
tance and effectiveness of staff development and 
inservice activities. These results are presented in 
Figure 6. The greatest discrepancies were found i| 
college classes (ranked high in importance and 
in effectiveness) and demonstrations (rank^^iow 
in importance and high in effectiveness). 

A summary of the positive results of staff 
development and inservice activities most fre- 
quently recor^^ed appears in Table 32. These results 
indicated a greater use of individualized instruction 
in reading and mathematics, better organization of 
inservice training,* and improvement in writing 
instructional objectives. Few schools reported 
improvement in teaching psychomotor skills, train- 
ing in the use of personnel, or improvement in- pupil 
attitudes as an outcome of staff development and 
mservice education activities. 

Recommendations for Improving Staff Development 

Schools participating in ECE programs reported 
frequent recommendations related to improved 
staff development programs and inservice educa- 
tion. The recommendations most often related to 





Five most 
important 


Five least 
important 


Five most 
effective \ 


Reading instruction 
Diagnostic/prescriptive 
teaching 
Math instruction 
Informal workshops 


Demonstrations 


Five least 
effective 


College dasses 


Formal lectures 
Intergroup 
relations 
Parent involvehient 
Parent education 



Figure 6^ f^tative importance and effectiveness of tan staff 
development activities provided by ECE schools, 
1973-74 
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improvement of the organization of inservice train- 
ing, increased visitation to other schools and 
programs, improved workshops, and better use of 
consultants. Aciditional teacher involvement in 
needs assessment and in the development of 
inservice activities were also recommended. The 
need for additional training in teaching techniques, 
particularly individualized instruction as related to 
diagnostic and prescriptive techniques, and in 
methods related to ir^proving pupil behaviors and 
attitudes, was mentioned frequently. 

Table 32 

Results of Staff Development Activities 
Most Frequently Reported 
by Successful ECE Schools, 
197374 







Percent of 


Schools 




successful* 


rank 




schools 


order 


Results 


reporting 


1 


Improved individualized instruc- 






tion In reading 


26 


. 2 


Improved individualized instruc- 






tion in mathenrwtics 


16 


3 


Better organization of inservice 






training 


11 . 


'4 


Improvement in writing instruc- 






tional objectives 


^ 8 



r •"SucccssfuP refers to programs v^hose objectives *ere either 
\ exceeded, attained, or partially attained 



Optional Components 

Optional components were included by nearly half of 
the ECE schools. These included music, art, health, 
affeciive areas,^ English as a second language (ESL), 
arid bilinguaheducation. • 

The optional Component permitted local school 
program directors to provide information on topics 
not specifically identified as "^mponents in the 
evaluation report form. These included music, art, 



health and science, physical education^ sociaT 
studies, ESL, bilingual education, and psycho- 
motor development. Additional subjects such as 
school management, program organizatipn, the use 
of facilities and materials, and a series of similar 
topics were reported. 

For programs described as optional, nearly 90 
percent of all schools reported that their stated 
objectives had-been either fully attained or partially 
attained. Effectiveness was most frequently mea- 
sured by subjective methods. 

Nearly one-half of the schools providing early 
childhood education programs reported activities 
in the optional component. More than 100 schools 
reported that a program for ESL was provided, 
some ^of ihem in the bilingual-bicultural program 
(Chapter 1258 of the 1972 statutes). It was found 
that the evaluation of the language development 
component of the bilingual-bicultural program relied 
heavily on objective methods, with several recom- 
mendations focusing orr continuing or expanding 
the program as program needs increased. In general, 
programs achieved their stated objectives, and 
program efTectiveness was evaluated by subjective 
techniques more often than by objective tech- 
niques. Specific recommendations related to the 
. improvement of classieoHniianagement, bett.er use 
of personnel,* continued e5tRansion of such pro- 
grarns, atid improved program n^nagement. 

The activities reportra for the\bilingual or ESL 
programs included the use of diagnostic and 
prescriptive teaching techniques and the use of 
instructional aides. The districts reported that the 
instructional aides were an efTective part of the 
program. 

Programs "funded under the Bilingual Education 
Act were also required to develop objectives in 
mathematics and the support components. The 
report prepared by the OfTice of Program 
Evaluation and Research, entitled BilingualJLduca- 
tion Act of 1972, contains a complete description 
of the bilingual program as it was implemented in 
California schools. 



ERLC. 



^ 0 0 a 5 



25. 



, • Chapter 4 

Fiscal Management 



Program expenditures as reported by the schools for 
1973-74 showed that additional early childhood 
education funds were most often used to employ 
instructional aides in the schools. 

The fiscal expenditures for each participating 
early childhood education school represen^d 20 
percent of the program evaluation in the 1973-74 
program year. Fiscal expenditures will represent 10 
percent of the evaluation in the 1974-75 program 
year but will not be included thereafter. 

The legislation requires that expenditures for the 
ECE program be supplemental to the districts* 
basic support per child. Each district signed an 
as^^urance in its original application certifying that 
its effort would be maintained. At the time of this 
report, specific audit procedures required under 
Education Code sections 6445.16, 6445.17, and 
6445.18 had not been accomplished. 

Final evaluation of -fiscal management covered 
only the actual encumbrances for 1973-74,and the 
amounts that were either carried forward into the 
next fiscal year or overspent, there was no attempt 
to evaluate the appropriateness by which schools 
chose to allocate funds within the school budget. 



Each school plan included the development of a 
budget which allocated funds in such a way that 
the objectives of the plan would be met most 
effectively. 

In this first year, 59^4 percent of the schools 
completed the fiscal yeai: with no more than a 5 
percent difference between the amount allocated 
and the amount sp^t. Another 14.5 percent of the 
schools had ending balances with a 6 to 10 percent 
difference. The remaining 26.1 percent had an 
ending balance >^th either carry-over or deficit 
funds in excess of 10 percent of the original 
budget. The evaluation of fiscal management gave 
full credit to schools at 10 percent or under, and a 
penalty of 5 percent of the total evaluation for 
amounts over 10 percent but less than 25 percent. 
Any budget with either a 25 .percent or greater 
deficit or carry-over was penalized 10 percent or 
half the possible fiscal management evaluation 
score. Schools that did not return budget informa- 
tion or whose figures were included in a district 
aggregate r^port^eceived a zero score for the 20 
percent evaluation of their fiscal management. • 

Table 33 presents the early childhood education 
expenditures by account classification. Over 44 
percent of the expenditureawere for instruptional 
aides, and nearly 85 percent of the* expenditures 
were in the general area of instruction, including 
salaries ^d instructional supplies. 

.While health heeds assessment was a part of the 
required plan for each ^hool, either district or 
community resources were utilized to fund this 
activity. Less than 1 percent of the expenditures 
were directed toward healtli services. 

The Early Childhood Education Management 
Team found that in a few districts, schools did not 
receive the full allocation authorized by the State 
Board of Education, because a percentage of the 
funds was removed for district administration prior 
to distribution fo the schools* 



Recommendation 

State fiscal reporting and audit procedures are 
essential to the early childhood education program- 
in order to clarify the fiscal responsibilities at the 
school, district, and state levels* 
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Table 33 

Total E6£ Expenditures by Account Classification, 1973-74 











Expenditure 




approved 


Expenditures 




and encumbrance 


, Account 


ECE 


and 


Not 


percent of 


classification 


budget 


encumbrances 

a 


encumbered 


total 


100 Administration 


$ 10,840 


$ 12,084 


$ (-1,244) 


^ 0,05 


jto-120 Salaries 


129,955 


123,701 , 


6,254 


0.68 


190 Other expenses 


59J13 


50,853 


8,260 


0.28 


200 instruction 










^ '212 Supervisors' salaries 


428,373 • 


420,898 


7,475 


2.33 


213 Teachers' salarres 


3,122,445 


3,046,831 


75,614 


16,83 


214 Other certificated 










salaries 


718,746 


672,109 


46,637 


3.71 


220 Classified salaries 


79,366 


77,809 


1,557 


,43 


' 221 Instructional aides 


o,4/b,UUl 


/,yoD,/o4 


4oo,21 7 


A A 10 

44,1 2 


2.2.2. Utner ciassitiea 










salaries 


• 808,121 


571,309 


236,812 


3.16 


230 Textbooks 


37,492 


^ 35,227 


2,265 


.19 


94n Dthpr hnnks * 


1 ^O, 1 oo 






.DO 


290 Other expenses 


37,761 . 


30,897 


6,864 


.17 


291 Instructional supplies 


1,962,856 


1744,443; 


218,413 


9.64 


IVi ibUClfcllicUUs 




770 OQC 
/ / J, J^O 




A 01 


400 Health services 










410-420 Salaries 


158,230 


136,344 


21,886 


, -75, 


490 Other expenses 


57,302 


34,713 


22,589 


1 

1.19 


500 Pupil transportation 


750 


750 


0 


.00 


520 baiaries 


1 / ,4d4 


0 An A 


0 A ~m « 

0,470 


.05' 


590 Other expenses 


77,209 


46,334 


39,345 


,26 


600 Operation of plant 










'620 Salaries 


3,802 


3,742 


60 


.62 

Y 

. .07 ^ 


690 Other expenses 


15,058 


12,011 


3,047 


700 Maintenance of plant 








r ' 


720 Salaries 

790 Other expenses 


18,522 
9,820 ^ 


3,060 
4,914 


15,462 
*4'906 


.02 
.03 


800 Fixed charges 


395,481 


356,225 


39,256 


1.98 


892 Lease/rental expense 










and fringe benefits 

900 Fqpd services 

910-9z0 oalaries 


1,132,478 


1,050,455 


82,023 


5.80 


400 


396 


4 


.00 


990 Othpr expenses 


41,767 


' 31,407 


10,360 


.17 


1100 Community services 


600 


6 


494 


.00 


11100120 Salaries 


38,745 § 


29,774 


8,971 


.16 


1 190 Other expenses 




\ 17,994 


8,212 


.10 


1200 Capital outlay 


13,470 


12,462 


1,008 


.06 


1240 Improvement of sites 


43,203 


36,146 


7,057 


.20 


1250 Buildings 


70,856 


71,267 


(-41 n 


.39 



if 




0 0 ,H 7' 



> 



Table 33 (Continued) 



classification 


Approved 
budget 


Expenditures 

df lU 

encumbrances 


r 

Mnt 

encumbered 


Expenditure 
and encumbrance 

Cci 1 1 U 1 

total 




1260 Equipment 
1261 Books 


$29>64^ 
41. 553' 


$23,815 
33.036 


$.5,649 
14,166 


.13 
J 8 


1 9fiQ Other enuiDment 


568 938 


538,623 


30,315 


2.98 


Indirect costs (rate percent) * 


55.814 


44.258 


11.556 




Total (without indirect costs) 


19.823.520 


18.100.970 


1.722.550 


100.00 


Total (with indirect costs) 


19,879.334 


1^145.228 


1.734.116 




Reports filed late 

Not filed or not separable 


2.936.407 
1.351.217 








Total " 


$24,166,958 
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